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The Santa Pe Precision Teaching for Effective 
Learning, (PTEL) an ESEA Title III program, was selected as a 
remedial instructional approach to the performance and motivational 
problems of Santa Pe students. It proposed the following six major 
program objectives: (1) planning and implementation of start-up 
activities; (2) staff training in the charting of student correct and 
error frequencies in reading and math; (3) staff training in setting^ 
individual behavioral objectives and mastery criteria for Students, 
and in concepts of the individualized management system; (k) training 
in reinforcement principles; 15) sequential ordering of behavioral 
objectives in the math arid reading curricula; and (6)* the attainment 
of Oakland Unified School District achievement score norms in math 
and reading by 60, 80, and 100 percent of PTEL students in program 
years one, two, and three, respectively. The evaluation demonstrated m 
that five out of six objectives were accomplished by the program. 
Curriculum planning and development of materials were initiated by 
the staff at the beginning of the program and continued throughout 
the year. The staff generally felt that the inservise training 
provided was effective and adequately prepared them to implement PTEL 
methods in the classroom. Santa Fe PTEL failed to meet the predicted 
objective of 60 percent of its students achieving QUSD reading 
averages by approximately 10 percent and math averages by 
approximately 14 percent. The staff's reaction to the program's 
operation, administration, and- organization was generally positive. 
(Author/BD) 
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. g, SANTA FE SCHOOL PRECISION TEACHING PROGRAM 

- • 

EVALUATION REPORT 
• • 1*974-1975 '' 

The Santa Fe Precision Teaching for Effective Learning 
Program, (PTEL) , is a Title III-ESEA furtded program operate^ by 
the Oakland Unified School District (OUSD) at Santa Fe Elementary 
School in Oakland* This program was selected as a remedial in- 
structional Approach to the performance and motivational problems 
of Santa Fe 'students. The 1973-74 achievement test results 
reported by the OUSD Research Department indicated that the average 
reading and math scores for Santa Fe students were, below those of 

I 4 

the OUSD in general. In addition, inadequate leve'ls of student 
motivation for -learning and school participation were inferred 
from the high rates of ^absenteeism and tardiness and from the 
high number of disciplinary office referrals which prevail at 
vSanta Fe School. 

The PTEL method was selected in part because it was judged 
to be compatible with certain factors in the S^ta Fe community 
which are thought to be associated with academic difficulties. 
The community surrounding Santa Fe School/ located at 915 54th Street 
in Oakland, .is believed to have a high rate of residential and 
school relocation. These factors are thought to create academic , 

difficulties for Santa Fe School students. Moreover, the - 

t * * 

Santa Fe School community is also a community in which many 

low income families reside. Although the unemployment rate 

is high, common occupations include . clerical work, construction 

*work, and longshore I'abor. A high percentage of the families 




ar'e receiving welfare assistahce, while approximately 80 percent 
of the students at Santa '^jt are'*in the free lunch program. 

Santa Fe School was built approximately 20 years ago* It 

\ 

is a 'structure which encompasses two buildings that are 

, / •< ' «■ . 

divided *by an asphalt playground. The -main building is a two-story 

structure with small classrooms on each floor, a library on the 

second floor, ar^ the school off-ice and cafeteria situated on 

the £irst floor. In addition, there is an old, small building 

behind the main school building, which has several Small classrooms 

'Classroom space is also provided by several portable buildings. 
The classrooms are generally light and pleasant, given the . 

^spatial conditions, and adequately house an 4 enrollment of 

approximately 550 students. 

All classes at Santa Fe have close to the upper limit of 

children per class size as set by the district (about 30 each) . 

In the last three years, the school has received additional money 

from Title I andVTitle III. It is a Compensatory Education school, 

an Early Childhood Education school, and has also had a 

Guaranteed Learning Program for the last three years. These 

f . J 

extra funds have provided two resource teachers and an early child- 
hdod education coordinator. These three people have become 
circuit chairmen for different grades. They coordinate acti- 
viti^ and act as resource people to Grades K, 1 & 2, 3 & 4, 
and 5 & 6, respectively. The Project Director cf the PTEL 
program works very closely with these resource persons and the 
Principal in an effort to coordinate the various programs at 
* Santa Fe School.- 

6 



. . Precision Teaching for Effective Learning (PTEL) i& a specific 
^instructional innovation. Tjje PTEL method consists of a" highly 
structured, diagnostic-prescriptive form of individualized teachY 
ing. PreGision teaching consists of a growing set of procedures 
that guide te^phere ^nd learners irT finding combinations of environ 
mental events .which affect the learner's performance. * It/ is . 

important to point out that Precision Teaching is^n'ot a 
specific method of teaching, nor a version of behavior mod- 
ification. Precision Teaching is a- way to plan, use, and 
analyze any teaching technique or method. It requires that teach- 
ers be taught how to diagnose each student's leviel of mastery 
of specif ic t reading* ^an<J math learning objectives, how to prescribe 
the subsequent learning activities appropriate for each child, x # 
and how to continuously evaluate each student's progress 
toward the specified learning objectives. 

o — 

% » ^ 

M The history and fundamentals of precision teaching 
can be tracedlto the operant conditioning work of 8. F. 
Skinner In the 19**0.s and 1 50s. Jhe concfept'of ".rate" as 
universal datum was probably Skfnner's greatest contribution, 
to precision teaching. The entire notion of precision teach- 
ing, as Qt Is known today, was initiated by Ogdefi R. Lind- 
sley In about 1 965 at the ^Un 1 vers i ty of Kansas. It was 
Dr. LindsleyJs intent to refine and extend the techniques 
of operant conditioning and beha v 1 o r .mod I f 1 ca 1 1 on so the.y 
could be used In measuring performance change In both 
so*cIal and academic behavior. Shjnce the mid sixties, through 
• the^efforts of Lindsley, Kunzelmann, Koenig and others^ 
mucti has been done in I mp 1 emen 1 1 ng * the principles of pre- 
cision teaching, not only In special education classrooms, 
but also in the regular class*. For example, much of today 1 s 
research uses the charting techniques developed under the 
'precision teaching movement. 11 

t 

1 Berk, Ray. M Prog ress ' Report 1 1 973-7** of an ESEA Title 11,1 
Project entitled Educational Remediatjon for Children with 
x ' Learning Deficits Through Precision Teaching 11 , Great Falls, 
Montana. 



This approach to learning was considered for use at Santa Fe 
approximately- 'four years ago. Several teachers ha# taken 
Precision Teaching workshop courses and developed an intense 
interest in this approach. A proposal was written for funding 
and the school received funds from the State of California to 
operate* this program for the first year in 1974-75 • Approx- 

imately one-half of .the classes at Santa Fe School are involved 
in* this project which includes 10 certified teachers and 10 
part-time assistants with approximately^ 234 students. 

The program's proposal specified a^series of six major pro- 
gram objectives as follows: 

• Planning and implementation . 
of start-up activities. 

* * • 

Staff training in the charting of 
student correct and error frequencies 
in reading and math. 

* ' • Staff training in setting individual 

behavioral objectives and mastery 
criteria for students ^ and in the ^ 
general concepts pf the individualized 
management system. m . . , 

• Staff training in reinforcement 
principles. 

o Sequential orderiiftKof behavioral 

* objectives in the math and reading 
curricula. 

• The attainment of OUSD achievement 
score norms in math, and reading by 60/ 
80 and 100 percent of PTEL students in 
program years 1,2, and 3 respectively. 

Telegraph Development Company undertook the evaluation 
of the Sarutra Fe Precision Teaching for Effective Learning Pro- 
gram with the goal of assessing each o£ the program objectives^ 
Specifically, the evaluation strategy was comprised *of five maj- 
or objectives, as outlined in the Statement of- Work: 

- , 8 



Verify Start-up Planning and Implementation — ■ 

* 

Each PTEL start-up activity is linked in the 
program proposal to specific calendar deadlines. 
Telegraph Development Company will establish the 
actual dates of activity accomplishment and 
determine the factors which have contributed to t 
the actual timing achieve.d. This will pp accomplished 
through interviews with the program ditf^ptor 
and teacher questionnaires. . ^]|' * 

Verify Staff Development — 

Program in-service testing results, will be 
examined and'the program director willjbe 
interviewed in prder to validate program 
compliance with' stated staff development 
objectives. In addition, teacher question- 
naires will probe teacher views regarding the 
adequacy and effectiveness of the various 

service training procedures. * 



Verify Curriculum Development — 



% 
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The development of behavioral objectives for 
the math and reading curricula will be assessed 
via an examination of the behavioral objective 
structures developed by Santa Fe PTEL staff. 
Views regarding the adequacy and effectiveness ^ 
of these ^curricula structures will be probed in . 
interviews. with the program director and in the 
teacher questionnaires. 

* Assess and Analyze Student Growth in Math and 
Reading Achievement — ^ . 

Indices of growth on State-adopted standardized 
achievement tests in math and reading will be 
analyzed comparatively to determine the impact of 
the PTEL program at each grade level on Santa Fe's 
PTEL students relative to Santa Fe's non-PTEL 
students, relative to nort-PTEL students in a 
control school, and relative to OUSD in general. 
The effects of varying degrees of student 
tenure in PTEL will be assessed in the 
longitudinal treatment of scores in subsequent 
progtam years. The data analysis design and 
procedures underlying student achievement 
comparisons are specified in the work statement. , 

* 

• Examine 'Preliminar y Indices of Student Motivation — 

Changes in the frequency of student attendance, 
tardiness, and. disciplinary office referrals <will 
be used to" gauge the impact of PTEL on student 
motivation for learning and school participation. 

•'* . 9 



METHOD 

Students 

There are three groups of student populations to be describ- 
ed as follows: The Treatment Group '(Santa Fe PTEL" Students) , 
the Control Group I (Santa Fe Non-PTEL Students)/ and Co'njbrol 
Group II (Non-Santa Fe, Non-PTEL Students). 

Santa Fe PTEL Students : Approximately 234 students parti- 
cipated in the PTEL program. The ethnig breakdown is approxi- 
jnately 98 percent Black, while the other 2 percent are charac- 
terized as Asian American, Filipino, Spanish surname, and Native 
American. Achievemerit scores for 1973-74 students* in* reading arid 
math indicated that all grade levels were below average, ranging 
from five months \to one year and seven months below grade level 
,in reading, and from two months to one year and seven months 
belcw grade level in math. As previously stated, the students 
at Santa come from predominantly low-income families, many 
receiving welfare assistance, and 80 percent of the population 

are in the free lunch program. Students were selected for the 

» m 

PTEL program according to their placement in the classrooms of 
teachers who opted to participate/in the program. This placement 
of students was performed by the principajL at Santa Fe School with 
out prior knowledge of which Santa Fe teachers would participate „ 
in the PTEL program. The grade levels that ' composed the PTEL 
population were as follows: one Kindergarten class, one 

, K, 1, 2 combination class, one Grade 1 class, one 1, 2, 3 com- 

* 
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bination class , one Grade 3 class , one Grade 4 class , oiye 4,»5 
combination class, one Grade 6 class , and one EMR-and one EH class 

Control^roup I : Approximately 316 students made up the 
population of Control Group I. As previously stated , about 
one-half of Santa Fe School's student population participated 
in the PTEL program; consequently the other half o£ this 
school 1 s "population constituted Control Group I. The ethnic 
breakdown , the academic achievement level , and the socio-econo- 
mic level is generally the same for this Control Group. I and 
the Treatment Group. Again, students were randomly selected . 

i 

for this Control Group by' the Principal as a result of class~ J 

cflAfplacenent. The grade levels that composed the Control </ 
Group I population were as follows: Two Kindergarten classes, 
one 2,3 combination class, one Grade 3 class, two Grade 4 classes, 
one Grade 5 class, one 5, 6 combination class, and two Grade 6 
classes. 
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Control Group II : Because of j^the 'possibility that Contrj 
Group I was influenced by its proximity to the PTEL classrooms, 
a second Control Group 'was constituted by selecting another 
OUSD school with demographic and skill characteristics similar 
to those of Santa Fe School.* 

Approximately 534 students participated in Cqptrol Group II, 
This included a total school population with grades Kindergarten 
through sixth. This particular school was selected as a secbnd 
control group because of the similar ethnic "and soc&Lo -economic 
'characteristics as well as academic achievement levels, Spe- 



Y ■ ■ 



cifically, the ethnic breakdown is approximately 95 percent Black, 
while the other 5 percent are characterized as Asian-Americans , 



"Spanish surname, Native American, and other White. Achieve- 
ment scores for 1973-74 students in reading and math indicated 
that most grade levels werfe below average, ranging in reading 
scores from one month to two years .$n& three months below grade 
level, and ranging in math scores' in *the first grade from one 
month above grade level to one year and seven months below grade 
level in the sixth grade. The students come from predominantly 
low-income familie^ as the school- is identified as a Compensatory 
Education School. Several other aspects of this school are similar 
to those of the Treatment Group. The school personnel included* 
three resource teachers and 20 part-time instructional assistant's. 
In that the funding- and support services at this school were similai 
to those of Santa Fe School, we assume that tnany variables 
involved in the educational process (other than the treatment * 
variables) were closely related. Control Group II was identified 
at the end of the program year for comparison purposes. It should 



be* pointed out that neither of the Control Groups constitute 



.true control groups for this study, .because neither they nor 
the PTEL group were created by random .assignment*. However, Con- 
troV Group II may be considered an adequate comparison group 
because of its demographic and skill level* similarities to 
Santa ,F« ^nd because it has no PTEL program * in' operation; • 
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The PTEL program began operation in September, 1974 
continued through 'the regular school year until June, 1975. 
The program was administered by a Project Director under the 
di^pct^supervision of the Santa Fe School Principal. The 
^.staff included 10 certified- teachers*, 10 part-time assistant teach- 
- ers, and one part-time clerk. The Project Director was/ respon- 
sible for overall supervision and organization of program 
activities, coordination and development of training materials 
and curriculum, the conduct of in-service ' training for staff and 
^parent workstaj^, and coordination of the PTEL program with other 
CLf school projg*4ms and support services. The teachers were respon- 
sible fc-r implementing the PTEL methods in their classrooms, 
supervising 'their assistant tedchers', and participating in the 
PTEL in-service training program^ The assistant teachers were 4 
hired for six hour^g^day to assist. teachers with instructional 
groups of students^ to give timed tests f to .chart student 
progress, to prepare drill sheets, and % f or general Student record^ 
keeping ♦ All personnel hired for the program were interviewed 
^by- .teams of teachers* parents., and^ administrators. Teachers 
voluntarily participated in the program. Became 10 teachers 
were needed for the program, all teachers at San%a Fe School had 
an equal opportunity to participate if tfcey so desired. The 
first teachers choosing to participate were s'elected and the 
remaining* teachers at the scJapol became a part of Control .Group I. 
\_J. ■ The PTEL in-servdce training^ workshops began in September 

for teachers and assistaX^s> and continued weekly until May, 1975. 

* • L 
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In addition, several weeks^ of workshops were held in June, 
1975 after school was out, for the purpose of assessing student 
progress and for developing additional curriculum materials. The 
in-service training program was implemented throughout the 
school year. It generally consisted of instruction in the fol- 
lowing areas: 1) pinpointing behavioral objectives for children 
and establishing mastery criteria for an individualized management 
system^ 2) charting correct and error frequencies; and 3) identi- 
fying effects of reinforcement and punishment. ' Training was 
conducted primarily by the Project Director with the assistance 
of various consultants (e.g., consultants in math, precision teaching 
,ard behavior modification. Techniques used to teach these basic 
concepts included the use of learning centers, reading materials, 
probleta-solving materials, games, and direct instruction by 
the Project Director. 

The staff Vas given three separate tests at the completion 
of training segments in order to evaluate * their knowledge of t 'a 
PTEL teaching methods. These tests were reviewed and scored by 
the Project Director to document the teachers 1 abilities to 
implement the PTEL program. 

PTEL instructional approaches may encompass either a fairly J 

traditional whole-class focus or the" more student-determined indivi- 

— « 

dualized classroom concept. Individualized instruction was more ap- 
parent in the PTEL classrooms because teachers and assistants devot- 
ed i ill i energy to^obtaining^ a timed sample of student per- 
formance everyday in order to monitor student progress, 'this 
allowed teachers to make appropriate instructional decisions on 
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a daily basis 'for each student. Generally, only reading, language 
arts, and math were taught via the PTEL approach, (i.e., daily 
timed testing and carting). In addition to* this, the PTEL 
classes' had- assistant teachers for six hours a day while ndn- 
PTEL classes afc Santa Fe had assistants for three hours per day. 
Again, this arrangement allows more individualized and small grcpup 
instruction. Most of the PTEL students were able to test 
themselves or one another and to chart their ow|i progress. The 
exception existed in .the Kindergarten, EMR, EH, and some first 
grade classes. The students ix^ttfese classes were simply 'not 
able to chart. Different, less difficult charts, will be used 
next year, so that all students can chart their own progress. 

As PTEL instructional approaches varied from class to class, 
so did the use of instructional materials. The McGraw-Hill read- 
ing program was primarily used in graded -K<T. .The Houghton-Mifflin , 
materials ware used primarily in grades 4-6. In addition, teachers reported 
using S.R.A. workbooks, Flesh word lists, Ginn language, Peabody Language Kits, 
Hayes Afro-American Reading, and many teacher-made materials. Pro 
ject Mathematics, a manipulative-based program, was the primary 
mode of matfi instruction. In addition, teachers reported using 

.R.A. materials, Commercial Drill and Practice Games, Wirtz 
Workbook, tapes, film loops, and many teacher-made worksheets 
and -drill practice games. . " 

Instruments * 

Two instruments, the Staff Survey Form and Project Director 
Questionnaires, were developed to ^btain the opinions of PTEL 

• ■ • • V 
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staff and their recommendations for future program approaches 
and activities. In addition, three standardized tests were 
identified for the PTEL program evaluation. These are State of 
California designated standardized tests- used for all OUSD 
elementary schools. 

Staff Survey Form : Staff descriptions and judgements regard- 
ing 1) program operations, 2) individualized teaching approaches, 
-3) educational impact, 4) in-service training prbgr&m, 5) parental 
involvement, and 6) program needs, were elicited by a self-admin- 
istered confidential questionnaire. In addition, tfre evaluator 
held small group interviews with teachers tp clarify responses and 
to gain additional information. The Staff Survey Form is presented 

in Appendix A. 
* , 

Project Director Questionnaire : The Project Director was 
interviewed" by . the evaluator. A questionnaire was developed for 
this purpose which included inquiries regarding 1) the dates of 
accomplishmen£**£or stated program activities, 2) issues related to 
staff development, 3) the curriculum development process, 4) par- 
ental involvement, 5) program impact, and 6) -program needs. The 
Project Director Questionnaire is presented, in Appendix B. 

Tests of Basic Experiences (TOBE) : This test, Levels K & L, 
is made up of Mathematics, Language, Science,. Social Studies, and 
General Concepts Scales. .'OUSD administered the TOBE to Kindergar- 
ten students* These students took on ^ two, parts of the test, 
Language and Mathematics. Specifically, the test attempts to 
determine axchild's mastery of fundamental mathematical concepts, 
basic language concepts, 5uch as vocabulary, sentence structure, 
verb tense, sound-symbol relationships, and letter recognition. 

12 16 . : 



Cooperative Primary Tefsts : This instrument probes six 
academic areas: Pilot tes£*v Listening , Word Analysis , Mathe- 
matics, Reading and Writing Skills. There are four forms of 



Ithis test: 12 A, 12 B, 23 A, and 23 B, which were administered 

I ' ' 

;to students in Grades 1, 2, and 3, Students in the evaluation 

j study, took<~pnly two parts of the test battery: Reading and 

[Mathematics. The -Reading section includes words^^entences , 

and paragraphs vhich must be read. The Mathematics section 

attempts to measure major math concepts in their emergent state; 

i 

e.g., number, symbolism, operation, function and relations, 
! approximation and- estimation, proof, measurement , and* geometry . 
• Comprehensive Tests of Basic Skills (CTBS) : • This test is 

'composed of four sections: Reading, Language, Arithmetic, and 
•Study Skills. It was designed to systematically measure those 
! skills prerequisite to studying and learning in subject-matter 
; courses. Students in Grades 4, 5, and 6 to6k three of the 
i sections: Reading, Language, and Arithmetic. Alternate forms 



of the test used were Q n , 



, and'R 2 - Specifically, the Reading 



test includes vocabulary and comprehension. The Language test 
j includes mechanics, expression, and spelling. The Arithmetic 
j teat .includes computation, concepts, and applications. 

t 

! Table 1 summarizes the instruments, forms, levels, and dates 

j of administration for the pre- and post- tests utilized in the 



j evaluation. *' 
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TABLE 1 STANDARDIZED TESTS ADMINISTERED TO STUDENTS 



SCHOOL 



GRADE TEST 



PRE-TEST FORM 
ADMINISTERED 



POST-TEST FORM 
ADMINISTERED 



Santa Fe 


K 


TOBE 


Wash 1 ngton 


K 


tobe' 


Santa Fe 


2 


CO-OP 


Wash I ngton 


2 


CO-OP 


Santa Fe 


3 


CO-OP 


Wash 1 ngton 


3 


CO-OP 


Santa Fe 


k ■ 


CTBS 


Wash 1 ngton 


k 


CTBS 


Santa Fe 


5 


CTBS 


Wash 1 ngton 


5 


CTBS 


Santa Fe 


6 


CTBS 


Wash! ngton 


6 


CTBS 



\Leve 1 



K 
K 



Form 12 B 
Form\l2 B 

Form 2 3\ A 
Form 23 \ 

Form Qj 
Form Qj 

Form 
Form 

Form Q 2 
Form ,Q 2 




Level L 
Level L 

Form 23 A 

Form 23 A 

Form 23 B 

Form 23 B 



( Grade 1 only took the tes-t in the Sprijig, 1 975; there- 
fore, no analysis of these test scores was done.)- 
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*' 1 RESULTS ' 

Staff Survey Eorm ; The Staff Survey Form generally disclosed 
positive teacher reactions and judgements program activities 
and outcomes. Teachers were asked to rate students 1 progress 
as a result of utilizing the PTEL methods in the classrooms 
during the 1974-75 school year. Table '2 shows some areas in which 
teachers rated math progress most highly, it also reveals some areas 
in which teachers specifically felt that improvement was needed. As 
can be seen in Table 2,* teachers felt that the* greatest improve- 
ment occurred in math readiness, counting, and in addition- 
subtraction with vfhple numbers. In the areas of measurement and 
a]3plication, problem splving, estimation and averages, and 
ratios, teachers generally felt that improvement was needed. 

The overall rating of teachers' judgement of student pro- 
gress in mathematical areas was +85. The calculation used was 
Greatly Improved (+2) , Somewhat Improved (+1) , and Little "or No 
Change / Improvement Needed (-2) . 

Teachers 1 opinions of students progress in reading areas 
indicate a great improvement particularly in the area «of word > 
analysis, reading comprehension, and language arts. Vocabulary 
development was indicated as an area that needed more improve- 
ment. Table 3 displays some of the areas of student progress 
in reading as judged by the teachers. 
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TABLE 2 . TEACHE (^JUDGEMENT OF 


STUDENT PROGRESS IN MATH 


- .1 

i 

i 




GREATLY 
IMPROVED 


SOMEWHAT 
IMPROVED 


CHANGE 
NOT 
NECESSARY* 


LITTLE OR NO \ 
CHANGE/ IMPROVE- 
MENT is NEEDED^ : 

\ 


Math read! ness , 
counting 

Add i 1 1 on , s ub t ract i on 
with whole numbers 


7 
7 


1 

c 

3 


1 

0 « . 


' • 1 

0 


Structure 6 properties 
(greater, less than, or 
equal) 


2 


8 


0 


0 


Mu 1 1 i pi i cat ion, d i v i - 
sion with whole numbers 


3 " 


6 

o 


0 


V 


Fract i on concept 


2 


6 


0 


0 \ 


Geome t ry , recogn i t i on 


3 


2 f 


1 


' . 2 



of shapes 

Measurement & applica- 
tion ( t i me , size, 
temperature ) 

Problem-solving, estirpa- 
tion, averages, ratio, 
we i gh t , e tc . 



• 1 



} 

* Teachers not reporting a change in an area on the table 
indicated that this concept was not applicable to theirgrade 
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TABiE 3' TEACHER JUDGEMENT OF STUDENT PROGRESS IN READING AREAS 



? jr-t,, 



V GREATLY SOMEWHAT •> > CHANGE LIT%E OR NO 

IMPROVED IMPROVED • , NOT CHANGE/ I MPftOVE- 

NECESSARY* ME NT, IS NEEDED 

1 — ^~ 

Sight recocjn i t i on* of 8 1 0 • 0 

whole words* * • 

Consonants , 7_ 2 1 0 

Word Origins * 0 % 2 0 t 3 

Crossword puzzle skill 0 2 0 3 

Following simple # 5 5*0 0 
d i rect i ons 

Determining author's 1 1 0 5 

mot i ve j 

Understanding riddles 3 0 2 3 

Spelling 6 2 0 2 / 

Listening ski 1 Is *' " ^1 * 6 0 \^ 3 




w 1 n 

Great ivfev/riting 2 *» 0 

* Teachers not reporting a change fn an area on the table v 
indicated that this concept was not applicable to their grade. 

The overall rating of student progress in reading areas 

was +200 using the calculation mentioned above* Teachers 1 opinions- 

differed for which group of students (below "grade level, at 

■ ' • \ 

grade level, or above grade level) J?rof ited^ most from the PTEL 

Approach, but most agreed that it Ijas helped to enhance students 1 

positive self-concept/* £orae 'teachers f^lt that they were more > 

* . , C 

effectiye using the PTEL approach in teaching jnathematics , and 

others felt spelling skills showed the greatest improvement 

with PTEL methods. 

Teachers generally agreed that the program administration was 

effective and responsive. Table 4 shows some of ^the areas of ad- 

ministration and organization as judged by teachers, , 

' • 17 • 21 . 
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TABLE 4 TEACHER JtPSjEMENT SCORE FOR ADMINISTRATION & ORGANIZATION 



STRONGLY AGREE SOMEWHAT DISAGREE STRONGLY 

AGREE SOMEWHAT DISAGREE 



P rog ram was we 11 
p 1 anned 

Program goals are . 
real i st i c 

The staff gets along 
we 1 1 with Pro ject 
Di rector 



5 
5 
9 



Project Director i/s 
responsive tp^tgff needs 

Program is wel^ coordi- 
nated with ptHer services 
within the school 

/ 

Staff has been able to 
effectively evaluate the 
program and institute 
chanoes on an c*h-going t 
basics 



2 
1 

9 



2 



i 




J 



/ .6 



■ L 



Overall, the* staff rated administration . and organization 
as +73. Calculations used were Strongly Agree .(+2), Agree 
Somewhat (+1) , t Disagree 'Somewhat (-1) , and Strongly Disagree (-2). 
The Project Director indicated that most dates for objectives 
relating to curriculum planning v/ere met. More discussion ^ 
related to this will follow. " - 

In the area of staff development, teachers al,so agreed that 
the in-service trailing provided was effective and that it 
adequately prepared them to implement PTEL methods in the classroom, 
Although the teachers were generally positive about the training, , 
mo'st felt that .they did not actually begin to effectively implement 
PTEL in the! classroom until December or January. They were 
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particularly responsive to the -consultants that f participated in the 



training workshops • One consultant, Ms, Beth Willis, was mentioned 
by most staff members as being outstanding^nd particularly helpful to 
teachers in their attempt to implement Precision Teaching in the 
classroom in various subject areas. Teachers also universally agreed 
that more in-service training is' needed for the poming program year. 
Table 5 below shows some of the areas of staff development as judged 
by the teachers. 



TABLE 5' TEACHER JUDGEMENT SCORE FOR STAFF DEVELOPMENT 



/ 
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STRONGLY AGREE 

• j 



\ 
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SOMEWHAT D I SAG REE STRONGLY 
AGREE SOMEWHAT DISAGREE 



The training developed 
speci f i c skills and 
knowledge that related , 
closely to what teachers 
needed to implement the . 
Precision Teaching 
P rog ram 

6 

Because of the gain- 
ing, teachers ft are we 1 1 
prepared in the following 
areas: 

Clearly understand- 4 
i ng the i nd i vi dua 1 
management system 

Charting the frequen- ' 8 
cy 'of correct or error 
answe rs . 

, Sett i ng behavi ora 1 h 
./ -objectives for each 
/ student. 

/ 

Setting mastery criteria 5 
for each student 

.Staff effectively planned 6 
*the Precision Teaching Pro- 
gram and cooperatively 
1 mp 1 emen ted it 



8 
2 



FT 

23 



or 



ft, 



Overall, the staff rated the /in-service training as +147 

/ ' * 

(utilizing the safte calculation mentioned above) . 

. The Project Director indicated that training in the behavior 
incentives approach, or behavior modification, was held very 
late in the year (April) and was never really implemented this 
year to a full extent in the classrooms . Two workshops were 
held in this area and many of the techniques learned will be 
tried next program year. 

« 

" In addition, specific student objectives were identified 
as a result of teacher assessment of students at the beginning 
of the year (primarily by teacher-made diagnostic tests) . Al- 
though students generally progressed through materials in a 
sequential order, specific behavioral 'objectives with long-term 
goals and acceleration rates were not established for students. 

Teachers were asked th^ir opinions regarding the use of 
PTEL methods in their instructional approach with students. They 
were positive in their judgements,- feeling that it is an optiirfum 
approach to' improving students' reading and math ability. Some 
felt that this approach made it easier for a student to understand 
why he/she might need more drills in certain areas and that 
he/she is competing with "self". Some felt 4&S*tthe individual : 
approach affected classroom management positively. In addition, 
teachers judged the instructional assistants as being very help- 
ful in the classroom. Teachers did indicate that although mosl 
students were charting their own progress, the -task was dif- 
ficult because of the complex nature of the chart format. A 
different form is planned^for use next program year. 

Table 6 shows som§ of the teachers' judgements of 

• PTJ3L as an' instructional approach. 

! . ' 
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Stable 6 teacher judgement sc^dre for ptel as an "instructional approach 

' " ' \ / . * 



STRONGLY SOMEWHAT DISAGREE STRONGLY 
AGR£E AGREE SOMEWHAT D I SAG REE 



Precision Teaching is the i5 . 
bptimum approach to improving; 
a student's read i ng- ab i 1 i ty 




Precision Teaching is the 
optimum approach to improving 

a student's mathematical j ^ • ' 

abilities. j ^ s ^ 

There is sufficient time in 3 3 *0 

'the Pnecision Teaching pra-. 
gram /to plan week.l^L 9 • . 

activities. 

Precision Teaching a ] Vows me 
to te^jrh i nd i vi dua l^studen ts 
better 

The recording; charting, *3 „ 6 1 

and prescribing are not unduly 
burdensome . 

The instructional assistants d 

were very helpful in the . 0r 

f ol 1 owi ng, watfs : $ , ^ 

t 

conducting small group 7 2 0 

or individual student 
activities 

charting student pro- 9 0 0 

, g ress . 

Students were capable of 3 j 7 0 

learning to utilize Preci- 
sion Teaching instruments 

effectively. * 

Precision teaching has in- 5 5 0 

creased teachers 1 enthusiasm 
about teaching math and 
reading 1 • , ^ 



The overall rating was +182 utilizing the same calculations 



as .mentioned above. 
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The Project Director* indicated that the PTEL approach involves 

T ■ 

the student in his own learning process; e.g. .progressing at 
his individual pace, making decisions fox himself, testing and 

\ s 

charting his progress, etc. This allows the student to become 
aware of his/her learning objectives which 'can provide a personal 
incentive &nd consequently , -can motivate the student to 
improve his/her academic abilities. \ / ^ 

It was felt that the PTEL approach lallows teachers to 
observe students 1 progress on a daily basis ' and therefore, enables 
teachers to more accurately know those areas in whiph the child 
.needs help. 

Teachers' opinions relating to the adequacy 'of instructional 
materials differed greatly. Six teachers felt there were suf- 

♦ 

ficient instructional materials for each student, while f our 
did not. When asked if; there were sufficient instructional 
materials of the type needed to implement the PTEL method, five 
answered "yes" and five teachers answered "no". Some teachers 

/ 

indicated a need for more materials to teach functions and 

"rj^ometry, appropriate math manipulation^, and subject area mar 

terials such as* Black history, social science 4 , and science. 
* 

Overall, teachers judged teacher-made worksheets drill and 
k practice games , and other te&cher prepared materials as the most 
effective instructional materials used to- teach reading and math. 

Teachers reported that approximately 60 jrao^nts j&isited 
or volunteered irt^ the i^r classes during the school year. In add- 
ition, each teacher stated that two to three parent-teacher 
conferences per child were held during the year and most felt 
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the conference/ were more effective as a result of the PTEL 
program. Some stated that the^ approach. e^ableS* them to present 
a clear picture oft;a. child' s progress^ to the parent. 

There were two parent workshops held during the year, 
conducted by the Project Director. The' PTEL program v/as explain- 
ed to the parents and some practiced the testing and charting 
themselves. At the end of the year, a fil^ wfes planned for the 
children on the night parents visited the classrooms. This appro 
proved to be effective in stimulating parent attendance. 

The staff generally felt that the limited number of partici- 
pating parents were interested in, and were ge^rally positive 
about," the PTEL program, but the quantity of pai^ntal involvement 
was insufficient. The st4ff has^irious plans formulated to^ 
l^ipr^^garental involvement jKext year, eg. home visits, field 
trips, telephon^calls, not4s..home, etc. 

As previously st^fe^a, Santa Fe School has experienced high 
rates of absenteeism and tardiness, as well as a high number of 
disciplinary office referrals. It\has been inferred that inade- 
quate levels of student motivation for learning and school exist 
because of this. One of the objectives of the PTEL approach is 
to facilitate student learning and motivation. Teachers were 
asked their opinions regaining student attitudes and motivation, 
Table 7 shows their responses to be very positive. Most felt 
that students* feelings about their reading and math skill 
abilities had greatly improved. 
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TABLE 7 STUDENT MOTIVATIONAL AND ATT1TUDINAL CHANGES 



GREATLY 
IMPROVED 



.SOMEWHAT 
IMPROVED 



CHANGE 
MOT 
NECESSARY 



LITTLE OR HO 
CHANGE*/ IMPROVE - 
H€NT IS NEEDED 



Indicate your students' 
grov/th in the following 
areas: * , 

Your students 1 pleasure 
in reading 

Your students 1 use of 
1 i b ra ry 

Your students' feelings 
about their own read i ng 
abilities 



\ 
\ 

' Vi 



Your students 1 apprecia- 
tion of read i ng skills in 
others 

Your students 1 fee 1 i ngs 

abgut their own ma th skills 

•» 

Your students' apprecia- 
tion of math ski lis 'in 
others 

Your students' attend- 
ance and tardy rates 



6 

6 
6 



k 
6 
1 



1 

0 



< 



Frequency of conflicts 
£ negative behavior 
exhibited by students 



Your 



$ t uden ts 1 
on daily 



pe r form- 
homework 



ass i gnmen ts 
• 



2 : 
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Student Attendance and Office Referral : The evaluator also 
examined preliminary indices of . student motivation to see if there 

V was a change in the frequency of student attendance, tardiness , 
and disciplinary office referrals. Table 8 shows an absenteeism 
tjfend from September, 1974 through June, 1975. As car/* be seen, 
moresstudents were absent the second half- of the school year 
than in the beginning, with the month of January showing the 

— .highest number of students absent ar^l the highest , total number 
of absences per month. / 

■ / 

TABLE 8: ABSENTEEISM DATES OF SANTA FE STUDENTS 1 97^-75 

~ : : J— I ~ ' , 

j Sep* Oct. Nov* De^. Jan. /Feb. Mar. Apr. hjay June 

: 

f OF 'STUDENTS . ^ 

ABSENT 1 DAY 61, 10? 96 91 132, 117* HI 114 111 58 



OR MORE 



/ 



TOTAL g OF 154 274 2 1 3 224 38 1 320 3 1 7 323 N 274 120 
ABSENCES > I 



Table 9 shows student tardy rates, fyr both Santa Fe PTEL 

A sample of 35 students 



students and Santa Fe ric^-PTEL students, 
was pulled from both groups and recorded. 



As can Ibe seen, there 



was a lower number of tardies in each month for r\on-PTEL students. 
Aga^i, the month of January, has the highest- nuniber of tardies for 
btfth groups. The month of January also had the highest number 
of absences. 
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TABLE 9 SANTA FE STUDENT TARDY RATES (SAMPLE OF 35 FROM EACH GROUP) , 



Sep. Oct. Nov. Dec. Jan. .Feb. Mar. Apr. Hay June 



§ of Tardies 
Santa Fe ' 1 1 \ 

PTEL Students 

#ofTardyes 
Santa Fe ilon- 2 
PTEL Students 



19 14 17 



11 . k 



1 ' 



i ' 

Table 10 shows jihe number of office referrals for disci- 
plinary reasons for^Santa Fe PTEL students. This is based on a 
10 percent sample (30) , pulled from all office referrals of -PTEL 
students. There appears to be no trend established. 



/ 



TABLE 10 SANTA FE PTEL STUDENT OFFICE REFERRALS FOR DISCIPLJNARY 
REASONS (30 IN THE SAMPLE) 



J 



Sep. Oct^ Nov. Dec. Jan. Feb. Mar. Apr. "May June 



# of Office 
Re f e r ra 1 s 



1 



-tr - 1 



1 



(There v/e re 3 Office Referrals v/ith no date) 

Student Behavior Charts: As the PTEL program is designed to 



move , children "^through sequentially ordered behavior objectives, 
summary charts wire developed by the staff for each student at the 
end of the program year. The data was summarized from each 
student behavior chart, developed to show student progress ii^Matfr 
and Reading concepts. As previously stated, the Starlin's fur- * 
riculum Ladder was used, which contains sequential mathematical 
behaviors through which students progressed. The behav\or bank 

contains Inventories which designate mathematical ^curriculum 

A— 
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changes. For example, "Inventory I - Our students will be 
able to compute accurately and efficiently - multiply x 0 to x 9", 
Each inventory contains items through which a student moves se- 
quentially. For 'example, "Item, #301 - multiply x 0 to x 1". 
For purposes of summarizing student progress in math, the staff 
counted the number of items on the curriculum ladder through which 
each student progressed. This data was summarized and can be 
sken in Table Progress in reading^wds more difficult to 

summarize, as students used varying materials at different levels. 
For instance, it can be seen on Table 11 that EMR students on the, 
average, mastered 7.1 sounds or letters. Kindergarten students 
achieved, on the average, 2.8 reading objectives. These include 
knowledge of the alphabet, rhyming words, hearing consonants, 

matching words, and reading words. First, second, and third 

/ 

grade students completed, on the average, 3.3 Sullivan Programmed 
Readers or 1.6 Sullivan Storybooks. Students in the fourth, fift^ 
and sixth grades completed 14 if un^^in the Houghton-Mifflin 
Reading Series, or 8.7 unii^In the Kottmeyer +4 Series. It can 
be seen from Table 11 that th£ number of actual weeks of progress- 

vary in math as well as reading. This was due to implementing the 

*■ 

testing and charting at different ;times (in the classrooms and ,with 
individual students) . Implementation decisions were made by the * 
staff when they felt they were adequately enough trained in the 
PTEL approach to implement it in the classroom. Ill" addition, cer- 

^ I 

tain students learned and understood the PTEL apr/roach prior to 
others. Another factor to consider 'is the high /transition rate at 
Santa Fe School. ^Some. students enrolled later /than others, and 
pome transferred to other schools in the middle of the year. 
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•TABLE 11 . PTEL STUDENTS' PROGRESS IN HATH AND READING AS 
SUMMARIZED FROM STUDENT BEHAVIOR CHARTS 1 



13 STUDENTS HATH 

Total actjual weeks, range 2 to 2)2 
- ; * average 1 k ^ 

Total number of items moved, range 7 to 35 

average 15,0 



EMR 13 STUDENTS .READING 

i 



Total actua'l weeks, range k to 12 

average 9 , 1 (Goldman Lynch) , 



Total number of sounds learned, range 2 to 8 

average 7 « 1 



Total number of S.R.A. Books completed, 



/ EH 6 STUDENTS MATH 



Total actual weeks, range 9 to 35 

Average 18,5 

Total number of items moved, range 2^ to 

* • average 67 




EH — NO DATA REPORTED READING 



i 



"erjc 



KINDERGARTEN -- '37 STUPE NjTS MATH 

' /Total actual weeks, range 2 >tro~~2k 

. a ve rage 10.2 

Total ijumber of items moved, range 1 to 20 

average 2 . 0 

KINDERGARTEN " 37 STUDENTS^-- REAP I N*G 

Total number of weeks, ran/e 2^ to 3J_ 
w 1 average 1 7 > 5 

^ Total number of* reading objectives ( as / de f i nea/by teache 

i^ange* Mo 6 / 
average 2 . 8 / 



? 




The Math ancf\Reading items do not constitute &n/6'qua Ki nte r va 1 scale, 
Tnus, acceleration over items must be # interpn«ea,wfth caution. 

1*2 



GRADES 1,2, & 3 " 116 STUDENTS -- MATH 



Total actual weeks,*range ^ to 32 

. ave rage 19 «F 

Total number of- J terns moved, range J_ to 102 

average 30 * 



GRADES 1, 2, S 3 " 116 STUDENTS READING 

Total actual weeks , range 2^ to 25 

ivSrage 1 0 . 8 



Number of Sullivan Pi^^ga^ammed Readers completed, 

range T to 6 
' ' ^ ave rage 3 > 3 

Number~oT^ Storybooks completed, ran^H. to ^ 

ave rage 1 « 6 

✓ ' 4 



GRADES k\ 5, &^4 . r --/83 STUDENTS 



MATH 



' Total actual weeks , range 2 to 38 
/ average 25 « 1 



/ Total number^ of Items moved, range J_ to 266 

\ '''<a v e r ag e 88 , 2 

GRADES 5, S 6\ — 22 STUDENTS -- READING 




Total actual weeks, range 8 to 25 

average 2 1 . 9 

Total Hojjghton Mifflin ujj>*<comp 1 e te d , range 9 to 15 

average 14,1 

Total + V Reading Series units completed, range k to 12 

t average 8 « 7 ~ 



/ * - 
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Achievement Test Scores : Three different tests (TOBE, Co-op 
Primary, and the CTBS) were scored for the number of correct 
responses and all raw scores were then transformed into scaled 
scores. Scaled scores were used in order that comparisons could 
be made between all levels of each particular tdst utilized* 
Mean scaled scores were then computed for both pre- and post- * 
tests on the basis of grade level and on the basis of test type 
(Grades K, 2 & 3; and 4, 5, & 6) . In addition, gains were 
computed for all scores on the basis of scaled scores and mean 
gains were computed by grade level and by tests. f 

The statistical analysis of test' scores included an Analysis 
of Variance of standardized gain scores by grade group. Consider- 
able debate has occurred in educational research circles ii/ 
recent ypars over the choice of appropriate procedures foL analyzing 

educational chang^ or gain (e.g., Cronbach & Furbey, 1970). 

I ' ' ' 

Because the Santa Fe PTEL evaluation study ia^ a clear example of - . 

the non-equivalent cx>*trol group design in which group selection 

. \ . . 

is not defined at the pretest, the standardized change score 
analysis wap^selected ^s advised by Kenny (1975). The leve^ of 
statistical significance was defined at the .05 confidence level. 

Comparisons were also made between the three groups — 
Santa Fe PTEL. to Control Grpup I, Santa Fe PTEL to Control Group II, 
and the comparison of tfie^two control groups. The T-Test was " 
used where appropriate with the s-tatistical significance 



OTonbach, E., and Furbey, L. How we should measure "change" — or 
should we? Psychological Bulletin , 1970, 7£, 68-80. 

^enny, D. A. A quasi-experimental approach to assessing , treatment effects 
I in the nonequivalent control group design. Psychological 'Bulletin , 
I 1975, 82, 345-362.* 



defined as .05. In addition, an 'analysis was "performed to deter- 
mine the percentage of students jin each school by* grade leVel . 

! 

who met or were above the Oakland Unified School District (OUSD) 
'averages. All analysis of scores was done in the areas of 
reading and matlv. The grade levels included in, the data are 

K f 2, 3, 4, 5, and 6. Grade 1 was excluded as only post-test 

J 

scores were available. 

j 

Table 12 reveals the pre- 'and post-test mean scores bjr 
grade level for all these gz&Qp^in reading. As can be seen, 
the Santa -Fe PTEL students in Kindergarten and Grade 3 scored 



higher on the post-test than did the two control groups. The 
Santa Fe PTEL students in Grade , 4 had higher post-test scores 
th<in did Control Group I. When ,pre-tests are considered', PTEL 
5 Kindergarten and Grade f 4 students scorfed slightly higher than 
either of the control groups. In all other* grades, the control 
groups scored higher on the post-tests. 

Table 13 reveals pre- and post-test mean scores for math 
by grade level for all th-r^e 'groups. As. can be seen, Grades K 
and 4 in Santa Fe PTEL, scored higher on the post-test «f^n did 

i 

either of the Control Groups, but also had higher pre-testr scores. 

j 



The Grade 3 fJanta Fe PTEL students scored higher on the post-test 
than Control Group I did, but acjain the pre-test mean score? were 
also higher. ' \ . 
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Table 14 shows at the Kindergarten level that the tp6$e 

groups did not differ reliably in reading achievement, / jfe/ display 

ed, *Santa Fe PTEL had a mean gain in ,TOBE reading sco^K/of 

17 ,17, while Control Groups I and II obtained mean reading gain 
' 1 • / 

scores of 14,13 and 15,33, respectively ( F (2,117) « 3/. 01,, 

p = ,37 )• The three groups at Grades 2 and 3 on the Co-o 




Primary do not differ significantly in reading achievement. 
Santa Fe PTEL had a mean gain of 7.61, while the two.Contp^l 
Groups achieved mean reading gain ^scores of 7,53 and 6.50, 
respectively ( F(2,209) # = .0.61,. p = .55 ). There was a sign* 5 
ficant difference in mdan reading gains in Grades 4, 5, an' 
on the CTJBS. Santa Fe PTEL had a mean gain score of 30/04, 
Control feroup 'J. had a mean gain score of 33. ,73, and Control 
Group II had £ medn gain score of 43. 36 ( F(2,36l) = 3,65, 
p « , 0^6) . yControl Group II did significantly better than Con- 
trol Gfoup I ( T(361 -df) = 2.JL£r"p < JH29) , and Santa Fe PTEL 
( T(3^1 df ) = 2.32, p < .021 ) . 

Table 14 also indicates that the Kindergarten groups ~do not 
differ reliably in mean .math scores. As can be seen, Santa Fe 
PTEL had a mean gain in TOBE math scores of 13.54, while Control 
Group I and II obtained mean math gain scores of 13.39 and 13.01, 
respectively ( F(2,ll8) = .05, p = .38 ). Grades 2 and 3 do 
differ significantly in mean math gain' scores on the Co-op 
Primary. Santa Fe PTEL had k^ean^math gain score of 7.14, while 
Control Groups I and II had mean scores of 12.-98 ar.d 11.27, 
respectively ( F(2,204) = 6.78, p= .002 ) '. Both (jontrol 
*Groups^ achieved more gain than did Santa Fe PTEL. Santa Fe 



i 



PTEL differed reliably from Control Group I ( j( 204df) = 2.822/ 

I * / 

p< .005 ), and Saftta Fe PTEL ? was statistically different from 

»' * i x / 

Control Group II (T(204df) =-3.634, p<.00M. Mean math gain 
scores (CTBS) do riQt differ reliably between groups. Santa Fe 
PTEL had a mean. math gain score of 30.3/1, Control Group I had . 
a gain score of "38.85, and Control Grj&up IJf had a mean math 



gain of 34.65 ( F;(2,320) '= 1.66, p 



.l/ ). 
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* The OUSD averages for the Spring, 1975 c are the following, as 
given to the evaluator by the OUSD Research Department in July, 
1975: . 

TABLE 15 OllSD AVERAGES -- SPRING, 1.975 ' 
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GRADE TEST READING MATi 



K -TOBE (Lang.) 5<8 . 6 3 • 56J*0 

2 Co-op 1*5.69 1*7.72 
Primary i 

^3 ^Co-op 151.65 155. *9 
Pr 1 ma ry 

* CTBS 3*9. *5 37*. 62 

5. CTBS *20.*3 A 1 2 • 37 

6 CTBS *3*.'77 *28.00 



The above averages have been transformed to scaled scores 
* - V 



The program objective for educational impact predicted 
that 60 percent of the Santa Fe PTEL students would achieve 
the OUSD achievement f score norms in math and reading in the 
first program year.* 



/ ""\ Table 1 6 reveals the number and .percentages of students 

by grade level that achieved at, below, or above the OUSD achieve- 

( 

merit averages in, reading on the post-test administered in Spring, 

1975. Mean reading scores did not differ statistically in 

four grades: Kindergarten-Santa Fe PTEL. was 58.3 percent above the 

OUSD average, Control Group I was 43. 5 percent above OUSD averages 

2 

and Control Group II was 54.8 percent above ( x (2df) = 1.20, 
*p = .55 ); Grade 2-Santa Fe PTEL was 40.0 percent above the OUSD 
average,, while Control Groups I and II were 35.1 percent and 



32.6 percent above avetage, respectively ( x (2df) = .21, p = ,90 ); 

Grade 5-Santa Fe PTEL was 27.3 peraent above the OUSD average,' 

and Control Groups I and II were 3fl.5 percent and 29.5 percent 

2 I 

above, respectively ( x (2df) = .4/4, p = .90 ); Grade 6-Santa Fe 

PTEL was 43.5 percent above the OIpSD average, Control 'Group I 

was 61.3 percent above, and Control Group II was 51.0 percent 

2 

above OUSD averages ( x (2df) = 2.78, p = .24 ). 

The mean reading scores for the third grade between groups 



-do differ reliably ( x (2df) = 7. 



55, p « .02 ) . Santa F* 



PTEL was 53.8 percent above the OUSD averages, while Control 
Groups I and II were 25.9 percent and 51.8 percent above average, 
respectively. In addition, Grad^ 4 mean reading scores ditfer 
statistically as Santa Fe PTEL was 51.7 percent above OUSD vaver- 

ages, Control Group I was 30.4 percent above, and Control G^roup 

t 2 i 

I II was 62.2 percent above average ( x (2df) = 5.73, p = .05 \). 

j As can be seen in Table 16 the Gr^de 4 me^n reading scores 

failed to achieve OUSD averages by only 10 percent a lower 

percentage than the two Control Groups. 
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Table 17 reveals the number and percentage of students 

by grade level that achieved at, below, or above the OUSD achie\fe- 

I 

ment averages in math on the post-test given in the Spring, 197*>.~ 

i 

Mean math scores do not differ statistically in three grades: "j 
Kindergarten-Santa Fe PTEL was 45.8 percent ctfx>ve OUSD math averages, 
Control Group I was 43.5 percent above, and Control Group II was 
50.0 percent above OUSD averages ( x (2df) = .35, p = .83 ); | 
Grade 2-Santa Fe PTEL was 4 0.0 percent abovlFt)USD averages, while 
Control Groups I and II were 56.8 percent and 44.7 percent above, 
respectively ( x 2 (2df) = 1.56, p = .46 ); and Grade 4-Santa ^e 
PTEL was 50.0 percent above averages, ^Control Group I was 16.7 
percerrt above, and Control Group II was 43.2 percent above i 
( x 2 (2df) ,= 3.93, p ■ .14 ) . Grade 6 showed Santa Fe PTEL was 
43.5 percent above OUSD math averages, while Control Groups I 
and II were 70.3 percent and 64.6 percent above, respectively 
( x 2 (2df) = 5.48, p = .06 ). This grade level was marginally sig- 
nificant with Control Group I having the highest percentage 
above the OUSD average. Grades 3 and 5 did differ statistically 
as follows: Grade 3-Santa Fe PTEL was 25.0 percent above math 

OUSD averages, while Control Groups I and II were 22.2 percent 

2 * 

and 47.4 percent above, respectively ( x (2df) = 7 . 55 , p = . 02 ) ; 

and Grade 5-Santa Fe PTEL was at the 0.0 percent level, while 

Control Groups I and II were 37.9 percent and 45.8 percent 

2 

above math'OUSD averages, respectively ( x (2df) = 8.22, p = *01 ). 
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Table 18 indicates- summary data on the numbers and percentages 

of students scores that achieved below, at, or above OUSD averages 

in reading. The three groups did not differ signiAcarttly. 

Santa Fe PTEL had the highest percentage above the reading. OUSD 

average at 49.3 percent, while the Control Groups I and II were 

42.4 percent and 46.6 percent above average, respectively 
2 

( x (2df) = 1.87, p = .39 ). It is important at this point to 



note that the Santa Fe PTEL students' stores failed €0 achieve 
prediction levels but overall were within 10+ percent of the 
predicted improvement. The Control GrOups/I and II failed to 
achieve OUSD averages by 18 percenj^cind percent, respectively. 
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table 19 shows summary data on the number 1 and percentages 
of students/scores that achieved at, above, or b^low OUBD averages 
in math. The groups did differ significantly. Control Group I 
had 48.9 percent above, and Contrpl Group II, with a percentage 
of 49.4 above, did better than Santa Fe PTEL which, had 36.0 

percent^above District math averages. Santa* Fe PTEL failed to 

« • • • 

achieve the predicted level by 14 percent in math. . * . * / 



A- 



47 / 



TRIC 



44 



oo 

LU 
CD 
< 

cc 

LU 
> 
< 

O 

00 

=) 
o 



o 



cc> 



CD 
< 

*cc 

LU 
> 
< 



•a: 
o 
o 
oo 

2: 



< 
o 



cn 



CO 

< 



00 00 

H LU 
Z LU CD 
LU > < 
O O CC 
D CO UJ 

HO 
00 < 
CC 

u. o o 

O CO 
I— => 

< o 



00 



00 



LU CD 
LU > < 

00 o: 

CO LU 

H < > 
00 < 

cc 

U. O Q 
O 00 
I— => 
< O 



00 



00 

LU 
CD 

LU < 
Q CC 

^ LU 
,1— O > 
OO -J < 

LU 

U. CO o 
o 00 

=> 
o 



00 

Z 
LU 
O 



00 
LU 
CD 
< 
CC 

ID 15 LU 
H O > 
O0 —I < 
LU 

, u. CO o 
o 00 
=> 

t *± o 



* a. 
r> 
o 
cc 

CD 



ERLC 



cn 

-3* 



vD 



CO 



LU 

I— 
a. 

a) 



c 

00 



cn 



CO 

-3* 




: co 



cn 



cn 

LTV 



vo 



o 

Lf\ 



vD 



O. 
D 

o 

u 

CD 



O 
u 

C 



o. 
o 

u 

CD 



O 
u 

C 

o 
o 



48 



45 



DISCUSSION 

The evaluation of the Santa Fe PTEL program revealed that 

- 

5 out of 6 of the major program objectives were achieved, some to 
a greater extent than others. \ , , 

• Planning and Implementation of start-up activities. 

The Project Director and instructional assistants were hired 
within the specified time schedule. The Project Director ordered 
various materials for program use and began to develop curriculum 
materials. The development of curriculum materials was an on- 
going process in which the teachers . also participated. 

• Staff training in the charting of student correct and error 
frequencies in reading and math. / 

The staff did receive training in the charting' of student 

. ■ | ./ 

"correct and error frequencies in reading and math. All / 

staff, teachers, and instructional assistants, demonstrated pro- 

• ficieocy in charting as measured by a test developed by the 

Project Director.-™ 1 

• Staff training in setting, individual behavioral objectives and 
s mastery criteria for students-,, and in the general concepts .of 

the individualized management system. ^ 

The staff -did receive training in pinpointing {behavioral 
objectives for each student and establishing criteria for mastery. 
fThey weire also trained, ip. the general concepts involved in an 
individualized management system. The staff was tested at the end 
of each session regarding each of the training objectives; all 
teachers demonstrated proficiency in each atea. The staff was able 
to pinpoint behavioral objectives for students by utilizing the 
established objectives in the reading materials and by using the 
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Starlin's Curriculum Ladder and Proiect Math materials for 
math objectives. There were no long term goals established 
for students; instead , specif xc/ objectives were esta- 



blished as a mechanism to mov^ students through a series of > 
sequential steps. Bstablishii^s^iteria for the mastery of 
skills was difficult for teachers. In most instances, proficiency 
.levels differed from student to student, depending on each stu- 
dent's abilities in a particular academic area. An attempt 
was made by teachers to raise a student f s skill rate to their 
automatic rate- Obviously, this took time and several trial 
tests to establish individual criteria for mastery. For example, 
using a on^-minute timed test, one student's proficiency level 
may be 40 "words/minute, while another student's mastery may 
be 70 words/minute. This is an area on which the- staff will be 
working more ^ the next program year. The problem involved in \ 
this task is whether an individualized criteria is the best approach, 
or whether an approach to normalize criteria for grade levels . 
is best. It becomes a complex issue to establish a. single cri- 
terion for a group of students who are each progressing at a 
different rate and who each display different abilities. 

0 ' 

i 

-^V^ -Staff training in reinforcement principled. 

# > 
Training sessions for the staff were held for the purpose 

of establishing reinforcement techniques to use with students 
during the late Spring, 1975. # Because of time limitations -in the 
first program Y ear / the staff placed its priotities in the area 
of developing appropriate curriculum materials and revising cur- 
riculum plans. During the first year of operations, time was not 
available to implement all of the planned reinforcement techniques 

' ' 47- 50. 



\ ^ 
in the classrooms as the staff would have liked. Many * of the 

techniques learned in staff training regarding reinforcement prin- 
ciples Will be implemented to a greater extent in_±he next program 
year. I , 

Another important point regarding the staff training is the 

fact that the training sessions were held in the afternoons after 



school was over , eu>3^eyQnd the teachers 1 scheduled wprk day. 
Although ; no staff member iadicate^o-tjje^ that" this was 

a major problem, no funds were provided to teachers for this 
training time. It was suggested by the staff that an alternative 
for the staff training time problem might be a modified school 
day. THe feasibility of this has not been researched by the 
staff, but the suggestion seems to be a good oner— — _ 

e Sequential ordering of behavioral objectives in the math an,d 
reading curricula . 

The staff adapted their reading^and math curricula to 

Precision Teaching. A variety of materials were used at Sahta Fe 

tfcis past year to, teach reading and math. The adaptation of these 

materials to Precision teaching was a lengthy process in which 

the* staff first studied the curriculum materials and then eva- 

luated them in terms of utilization. Next, they organized the 

materials into behavioral objectives in sequential order of 

difficulty, so that ^tudents could move from one phase to the 

next at his/her own rate. The math curriculum ^was revised first 

, ♦ 

and the reading curriculum second. Although there were variations 

t between classrooms, the staff spent several months working in 



this area. In addition, the staff began to adapt 

culum in social studie's, spelling, and other f academic subject 

/' 

areas, to Preqision Teaching for use in futiire program years. 

# The attainment of-^i^trict achievement .score norms in math and 
reading by 60, 80, axjd 100 percent of PTEL students in program- 
years 1, 2, and 3 respectively. < . 

The Santa Pe PTEL program failed to meet this objective. 

Although the Santa Fe PTEL group only missed^ achieving the 60 

percent at-norm level by about 10 percent fix reading, the two\ 

Control Groups were less successful in -bringing students tip to 

the district's Spring, 1975 norms. Three grade Levels in Santa 

Fe PTEL ( K, 2, and 3 ) . also produced a higher percentage of 1 

students scoring above OUSD averages, relative to their respective 

Control Groups. 



Santa Fe PTEL 1 s objective for math" scores was missed by 

\ 

approximately 14 percent. The Grade 4 math scores also indicated 
a greater tendency toward the OUSD averages than did either of 
the Control Groups. It appears that overall, there was- more 
progress in reading scores than in math scores by the students 
in the Santa Fe PTEL program. ) 

It must be pointed ofett here that the test results presented 
in this report should be interpreted with caution as a means of 
evaluating the impact of the Santa Fe PTEL program. As already 

stated, PTEL methods were probably not implemented effectively;,* 

'*j y N 

in the classrooms for more than four to five months. Thjis was the 

first year of operation and staff training had to be put: in place, 

I 

prior to implementing the PTEXi methods in the classrooms. It. 
C ^mig)it also be Assumed that the PTEL methods in the upper' elementary 



grades were not fully operational for Certain mathematical con- 
cepts. The Starlin's Curriculum Ladder was utilized by the staff , 
but did not include items in the area\of fractions, measurement 
and application, geometrical concepts ,^tc. The CTBS did cover 
these content areas. The staff repeated tJiat they are in the 
process of developing materials in ffig&e concept areas that can 
be used next year^with the PTEL apj 

In the area of reading, it can^e assumed (based on staff 

/ 

reports) that similar reading juatemals were used throughout 

Santa Fe classrooms. Therefore,, the difference in an instruct 

f - 
tional apprdach to reading between' Santa Fe PTEL and Control 

Group I teachers was the PTEL approach to setting behavioral 

"objectives, testing, charting progiress, etc. As already seen 

t is" 

in t^iis report, some 'grade levels in the Santa Fe PTEL program 
did significantly better in reading than students in the Control 
Groups. \ 

>Sts should not be used as a ga^uge 



Perhaps s 



tandardized t 



of program value during the first year of operation. This would 



seem especially 



T 



true in the j^se of Santa Fe's PTEL program due 
to the amount olf /time required by staff and students f6r 
process-related activities that were necessary to the initiation 
of the new program. % This concern for analyzing standard test 

» V 

scores as a part of the program evaluation was expressed J2y:jthe_ 

evaluatpr a priori; i.e., before post-tests had evfen befen 
administered. It is commonplace for programs that are instituting 
innovative educational practices to require a period- of incuba- 

tion before student: gains become apparent. Even 'a relatively \ y 

» , ' - • > ■ r . 

inferior standing is frequently attained by students in innovative 
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programs during the first implementation phase (e..g. ,.. Kenny , 1975), 
This situation is generally felt to be tolerable if improved 
student outcomes begin to accrue shortly thereafter. Thus,, the 
reading and math skills of PTEL students at Santa Pe should be 
observed closely during the early months of the 1975-1976 academic 
year and program changes considered, if improvement does not 
begin to appear. * 

One problem encountered in the analysis of achievement 
test scores was the loss of data. There many students with 

only pre-test scores and no post-test scores, orWice versa. 
Table 20 reveals the difference in the number of Students' with 
pre- or post-test scores. To further complicate tha£ analysis ^ 
a fairly large number of students took only some of the *sub- 1 
tests rather than all sub-tests, and therefore did not have total 
reading or math scorW?\In addition, some students 1 names 
appeared/twice on the computer p^Hnt^i^ the 
OUSD Research Department. For the above statea^eascnrf; caution 
should again be used when interpreting the -test scores. 

A revieVof Table 11 in the Results seption of this report 
reveals student progress in reading and math. The EMR students 
achieved an average 6f 15 math items and complied 2 S.R.A. ' 
workbooks. It seems commendable that children who' are education- 
ally mentally retarded, could have made such progress. The data 
also shows that educationally handicapped students (EH) progress- 
ed through an average of 18.5 mathematical items. The table 
also indicates progress for other students. This data is help- 
ful to staff; students/ and others interested in the extent of 
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classroom achievement made by students. EMR and EH students are 
not normally tested by standardized telsts as are the other students* 
Thus, the data summarized from student behavior charts x %s one of 

the few available pictures of these students' progress and it 

v * 
should assist the teachers who will be working with these students 

next year. > . 

♦ * 

• Student Motivation 

While student motivation for learning was not articulated 
as a major program objective, it is centainly one of the -impacts 
^of the PTEL approach. It is important to mention at this point 
that the data reported regarding^ attendance and tardiness, as well 

as office referrals, should be' viewed with caution. It should 
not necessarily be interpreted that students were not motivated by 
the PTEL program as a result of the above mentioned data. These 
We^re the only indices reviewed by the evaluator and conditiorts^^ 
beyond the staff's control could have existed, such as turbulent 
weather conditions, the flu- (or other contagious diseases), an 
epidemic, or family problems, that could have caused low attendance 
or tardiness. A major concept involved in the PTEL approach* is 
the motivation of students to learn and therefore, to progress 
at a higher rate academically. The concepts ^invoiyed in the 
PTEL method, such as the testing and charting of student progress, 

the individualized management system, and reinforcement princi- 
» 

pies of learning, all contribute to a student's motivation to le^fri. 



00 

tu 
a: 
o 
o 

oo 



X oo— 
K tu 

OO 2 



00 «C vD vD O CM 
CM 



(TV 



UJ UJ 
O > 
Z> tu 

I 

OO X 
O 

u. < 
o 

o 

^tfc 2 



— OO 

tu 

oo o 
I— u 

2 OO 
UJ 

o h- 

H tu 
oo H 
I 

U- I— 

O 00 

o 



0* 



vD O t+\ O 

vD vD vD p** 



tu 
oo a: 
I— o 
2 o 
tu oo 
o 

z> h- 
H c/> 
, oo tu 

I- 

o tu 
a: 
=tfc a. 



oo vD cn »— IA o 
IA' in N vp o 



CM 

4 1 



tu 
o 

< 

a: 
o 



S£ cm o*\ 



LA V0 



< 
■J- 



53 



I 



RECOMMENDATIONS 

This evaluation of the Santa Fe Precision Teaching for 
Effective Learning Program, 1974-75, points to recommendations 
for future programs and for future evaluations. The recom- 
mendations assembled reflect the evaluator f s viewpoint, butf 
incorporate numerous staff suggestions. 

Program Recommendations 

1) Provide additional staff training sessions (conducted 'by 
professional consultants) in thej following ar*eas : 

a) Goal-setting: How to establish long-term goals for 

' student learning and performance, and how to pinpoint 
behavioral objectives for each student. 

b) Establishing criteria for the mastery of basic 
skills for students 

s c) Implementing behavior modification or behavior incentive 
approaches; How to identify and utilize reinforcement 
techniques for essential .desirable classroom behaviors 
as well as for higher order cognitive skills. 

These workshops for staff,, should be followed up with tech- 

nical assistance to teachers in their individual classrooms in 

order to help them effectively implement the concepts listed 

above . ~ 

2) Provide additional "work which is required for the develop- 
ment of curriculum materials in order that they can be used with 
the PTEL approach. Specifically, math materials and tests are 
needed in the areas of measurement, geometry, functions, and 
problem solving. An alternative to developing these materials 
is to review additional commercially available materials which 

might already suit the program f s purpose. 



3) Establish a "Modified Day 11 for Precision Teaching classrooms 
for staff training workshops and development of materials. 

4) Devise and utilize simplified progress charts so that all 

* * 

students can learn to chart their own behavior, 

5) Provide training for all new students (including EMR, EH, 
and Kindergarten) in testing themselves and charting their own 
progress, 

» 

6) Encourage and plan a concentrated effort by all staff in 
order to develop and implement parent involvement. Possibly some 
of the approaches mentioned by the staff such as telephone calls, 
home visits, etc, will help to encourage more "parent participa- 
tion. Perhaps, instructional techniques could be developed that* 
parents" could use at home with. their children. 

Evaluation Recommendations 

1) A review of appropriate indices for assessing student 
motivation for learning and school participation should be 
performed'. Perhaps a comparison of student attendance, tardi- 
ness, and disciplinary office referrals could be conducted over 
a three-year period as one measure of student motivation, 
A survey of student attitudes toward learning could also be 
conducted on a pre-, post- basis in order to determine whether 
student self-image is affected during a year of participation in 
the PTEL program. 



2) A survey of student opinions should be performed in order to 
gauge participant views of the PTEL apprbach. 

3) Summary Behavior Charts of students should be revised so' that 
' the data could be appropriately used to measure academic growth 

and to determine the impact of the PTEL program at each grade 
level. If specific behavioral expectations for each student wpre 
developed/ these Summary Behavior Charts would permit an indivi- 
dualized assessment of the PTEL program's ability to 'achieve 
student-specific objectives during the next program year. 

4) A review of achievement test administration 'should be made. 
Student by student documentation* should be kept of the fre- 
quency and reasons for children transferring in and out -of 

4 

Santa Fe School, or for other reasons related to the lack of 
pre- and post-test achievement scores. In addition, the circum- 
stances leading to partial test scores should also be examined. 4 
There is. a general need for uniform, complete, unbiased, and 
reliable data in educational settings where program evaluation is 
required. Perhaps Santa Fe should consider planning for some 
of these testing needs prior to the 1975-76 academic year so that 
their first year of full-scale PTEL operation wi,ll be accompanied 
by test data that is relatively, less restricted in interpretation 
than is the data from the current. year . 
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APPENDIX 



PROJECT DIRECTOR QUESTIONNAIRE 



IDENTIFYING INFORMATION 



1) 'Briefly describ^^he school, its history, population 
the facility t , /€he community environment, etc. 

'/ i y 



2) Briefly describe the classroom (environment, s^e, • 
setting, etc.) ' Indicate if the Precision Teaching 
classrooms are different in any way 'from the others. 



61 



3) How was your school selected to participate in the • 
Precision Teaching Program? 
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\ \ 

4) How were teachers selected to participate in the 
Precision Teaching Program?, 



5) How were ^students selected who participated in the 
Precision Teaching Program? 



6) Describe the -curriculum planning process for the 

Precision Teaching Program and indicate implementation 
dates for major activities • 
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7) What are the main things that you hatf hoped to achieve 
th\s first program year? 

\ » 

\ 



8) Have you be$n trained in or used the following prior to 
administering this program? Please be specific, 

a) Behavior incentives approach to learning 

. f training used 



b) Precision Teaching approach to testing and charting 

training used 




c 
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c) , Establishing behavioral objectives 

training ,used 



If so, what are your impressions of the impact of these 
concepts on students learning abilities, both in reading 
and math. 



STAFFING 



1) Identify all Precision Teaching staff and s 
responsibilities of each: ^\ * 

:ites 




Position 



Responsibility 



Ethnicity- 



Length of 
time in P.T, 
Program 



2) Identify all support services at Santa Fe and specify if 

these services are offered only to Precision Teaching staff * 
and students or only to non-Precision Teaching staff and students* 



A> ■ 

3) Hew does the Precision Teaching Program link up with other services or 
programs? " IT 



4) , Is there adequate* staffing for the Precision Teaching Program? 



yes ho Please explain. 



r 



5) How have the Precision Teachers generally responded to 
the Precision Teaching approach? 



6) How do the other teachers at Santa Fe (not in Precision? 
Teaching) view the Precision Teaching approach? \ 

» 




\ / 
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STUDENT POPULATION 



Please complete the fallowing fot Sajita Fe School (1974-1975) 

1 NON-PRECISION 



PRECISION TEACHING 



TEACHING 



# of classes 




0 


# of students 




2 - - 


% of ethnicity 






economic level 


• 




past performance level 






% of ^bilingual 






% of 'handicapped , 






turnover rate - 


- — - ■ - 





Specify* if any of- the above areas have affected the 
Precision Teaching Program in a special way. 
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II. STAFF DEVELOPMENT 

1) Were all staff members adequately trained to: 



(a) pinpoint' behavioral^ objectives for 
each student 

(b) establish criteria for mastery 

(c) list components of individualized 
management system T" _ ^ 

(d) chart correct and error frequencies 



(e) identify effects of reinforcements 
punishme&t 



Yes 


No 























2) Please describe the Precision Teaching in-service 

training program, indicate dates, problems encountered, 
etc. (review in-service records) 



/ 



3) How did you assess the effectiveness of the in-service 

training for your staff? (by teacher tests provided to us?) 



0 



68 



N. 



4) Describe how results of teacher tests were used as 
diagnostic prescriptive tools for teacher training 
(Obtain results for these tes£s) 



INSTRUCTIONAL PROGRAM/MATERIALS 

1) Please describe the reading and math curriculum. 
(Review the curriculum objectives) 



2) Are all students - involved in charting and taking 
timed tests? yes no Please explain 



G9 
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3) What materials are currently being used to implement 
the Precision Teaching program? Please indicate which 
of these are effective or not, , ^| 2 



4) Was there sufficient quantity of instructional materials 
available to implement the Precision Teaching program? 



yes 



no 



IV. COMMUNITY/PARENT INVOLVEMENT 

1) What activities were planned and implemented to involve 
the community in the Precision Teaching program? 
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2) Do you feel the parental involvement this year .was 
adequate? yes no Please explain. 



r 



3) What was the general response of the parents to the 
Precision Teaching program? 
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V. IMPACT OF PRECISION TEACHING 



What impact do you feel this program has had on students, teacher 
and parents? (Indicate amount and supporting evidence wherever 
possible •) 



Beneficiaries 


Quant* Measures 
of Impact 


Source 




% Affected 


Amount 


(i. e. indicator of 










Student Performance 




• 


( 


Student Attitudes 
• 




i 




Teacher Behavior 
(i.e. teaching style — 
not* specific training 
objectives )^ 






• 

• 


Teacher Attitudes 






* 

« 


Parent Behavior 








Parent Attitudes 






4 



In your opinion, does the student program justify the additional 
time spent on in-service training, paperwork, etc.? - 

> 

72 



VI. What changes or recommendations would you make for the 
program in the following areas? 

1) Curriculum Planning and Implementation 



2) Staffing 



73 



'ERIC 



7.0 » 



3) Staff Development 



4) Instructional Program/Materials 
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5) Community/Parent Environment 



6) Program and Student Impact Evaluation 



\ 



c 



7) Additional Comments 



. : 75 • 
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STAFF SURVEY FORM 



SANTA FE PRECISION TEACHING PROGRAM 

1974 - 1975 / 

S 

s 



y 

The attached survey is intended to obtain teacher 
judgements on several aspects QjKsanta Fe School's Precision 
Teaching Program. JThese judgements form one of several parts 
of the official program evaluation for the Oakland Public 
Schools. 

Since teachers are most directly and intimately knowledgable 
about the effectiveness of ^ny new instructional effort, we are 
requesting your assistance in assessing the progress and impact 
of the Precision Teaching Program. Vie, are interested in your 
opinions, observations, and, judgements about the nature and 
effect of the program as it relates to your students, their'* 
parents, and you as a teacher. Please be frank in your responses. 
All answers will be treated with the utmost confidentiality. No 
information identify iag individuals will be disclosed. Thank 
you for your help. • - 

Classroom Grade Level 



/ 



/ 



/ 



•/ 

• /' . 

SANTA' FE PRECISION TEACHING. PROGRAM 
STAFF SURVEY FORM ' 



„ * 



^PLEASE MARK THE BOX WHICH REFLECTS YOUR OPINION MOST CLOSELY FOR EVERY STATEMENT* 



I. ADMINISTRATION AND ORGANIZATION 
1. The program was well planned . 



2. The timetable of the. program was 
accurate and included all necessary 
activities, 

3. The program goals are well defined. 



4, The program goals are realistic . 



5. The program is effectively 
administered. 



6. The staff gets along well with 
the Project Director. 



7. 



The I^roject Director is responsive 



td/Staff needs. 



The program is well coordinated 
with o£her services within the 
school. 



9. The 



The program has correctly ^allocated 
its funds for staff,' materials, 
an4 other expenses.' ■ ' * 

Staff has been able to effectively 
evaluate the program and institute 
changes on an on-going basis. 



COMMENTS: 
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STRONGLY 
AGREE 


AGREE 
SOMEWHAT 


DISAGREE 
SOMEWHAT 


STRONGLY 
DISAGREE 
— i ^ 












0 




* 

4 * 


• 


* 




• 


- 






» 






» 




* * 


' - 


> 
















• 








t 


/ 








/ 
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II. TEACHER T RAINING ' 

/ • y * \ 

1. The training developed specific skills 
and 'knowledge that related- closely to 
what teachers needed to* implement the 
' * Precision Teaching* Program. 

/2. Because of* the training, teachers ■ 
^re well prepared in the following 
^reas: 

4* Clearly understanding* the individual 
management system. 



b. Charting the frequency of correct 
"or errof^aowfirs . 



STRONGLY ' 
AGREE 


AGREE 
. SOMEWHAT 


DISAGREE 
SOMEWHAT 


STRONGLX 
DISAGREE 


i 









c. Setting behavioral objectives for 
each student. 



d. Identifying appropriate activities 
for specific students at particular 
points in theft learning process. 

e. Setting mastery criteria for each 
student. 



f. Assessing students 1 mastery of a 
stated objective. 



g. Creating or implementing appropriate 
. behavior management techniques. 



Training sessions were generally 
held at a convenient time. 



There was ian adequate number of 
training sessions. 



ERLC 



Staff effectiv§ly planned £he Precision 
Teaching Program and cooperatively 
implemented it. 

V \ • 

79 



f 








» 


■ 










\ 
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* 
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* 
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II. TEACHER TRAINING - page 



6'. Staff visits to Precision Teaching 
classrooms in other schools was a 
very; helpful teacher training approach. 

(please note^lf these visits did not occur^ 

7. Th£ feedback given to teachers during 
training actually brought about" im- 
provements in teachers 1 performance 
and program implementation/ (please note 
'if feedback was not given) 



STRONGLY 
AGREE 



7 



COMMENTS: 



/ AGREE 
'SOMEWHAT 



DISAGREE 
SOMEWHAT 



STRONGLY 
DISAGREE 





III. INSTRUCTIONAL APPROACH 



1. Precision Teaching is the optimum 
apprbach to improving a student 1 s^ 
reading ability. 

2. Precision Teaching is tt\e optimum 
appfoaqh to improving a Student f s 
mathematical abilities. 



3'; There" is sufficient time in the 
Precision Teaching program to plan 
weekly activities*. 



to small groups better. 



5. Precision Teaching allows me to teach 
to individual -students better. 



6. Precision Teaching has actually 

improved my personal teaching skills. 




Precision Teaching's behavior incen- 
tive approach lids been especially 
effective in /improving" math and 
reading skill's. 

The recording, charting, and pre-, 
scribing a*e not unduly burdensome. 



The instructional assistants were 
very helpful in the following ways: 
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STRONGLY 
AGREE 


! 

s< 


AGREE ' 
5MEWHAT 


DISAGREE 
SOMEWHAT 


STRONGLY 
/DISAGREE 
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dual student activities, 

b. charting student progress. 

? *'■ 

c. setting mastery criteria, 
(continued on next page) 
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III. INSTRUCTIONAL APPROACH-page 2 

d. setting learning objectives 



9. Students were capable of learning 
to utilize Precision Teaching 
instruments effectively. 



10, Precision teaching has increased 

teachers' enthusiasm about teaching 
: math and reading. 



J 11, Are your students 1 aware that they 
are involved in a special program? 



STRONGLY 
AGREE 


AGREE 
. SOMEWHAT 


disagree 
"somewhat 


strongly 
disagree 


<- 


■ — i 


M 

• 










t 


0 
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Yes 



No 



COMMENTS : 



J 



82 



79 



I 



IV. MATERIALS 



1. Please indicate how effectively each 
of Xhe following reading/language 
arts tnaTetials are (if used) in 
the Precision Teaching Program: 

a. Teacher Prepared Materials 



b. Sullivan 



c. S.R.A. Skill Boxes 



m d. Harper Row Readers or Worl^ Books 



e.Bank Street 



f . Lippincott 



g. Sounds of Language 



h, MacMillan 




i. Houghton-Mifflin 



j.' Other materials : 



OMMENTS : 



83 
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VERY 
EFFECTIVE 



SOMEWHAT 
EFFECTIVE 



NOT 
EFFECTIVE 



DO NOT USE 
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IV. MATERIALS -page 2 



2. Please ihdJx^te how effective each 
je/ollowii 
are (if used) i\ the Precision Teach- 
ing Program/ 

a. Project Mathematics 



b. Wirtz Materials (CD. A. Math) 



c. Houghton-Mifflin Text (Modern 
School Mathematics) 



d. Addison Wesley text (Elementary 
School Math) 



e. Franklin Materials"(Patterns and 
Puzzles, etc.) 



f. Individualized Program 
(Specify) 



g. Computation Practice Kits 



h. # Math Lab Manipulables 



i. Commercial Worksheets 



j. Teacher-Made Worksheets 



k. Physical Number Aids 



0 ^ (continued oi> next page) 
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VERY 
EFFECTIVE 


SOMEWHAT 
EFFECTIVE 


NOT 
EFFECTIVE < 


DO NOT USE 
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IV, MATERIALS - page 3 



Commercial Drill and Practice Games 



"m.\ Teacher-made Drill and Practice 
Games 



n. Tapes, Film Loops, etc. 



o. Mathematics Library Books 



p. Other Materials (Specify)_ 



VERY 
EFFECTIVE 


SOMEWHAT 
EFFECTIVE 


HO? 
EFFECTIVE 


DO NOT USE 


t 




- 






/ 




• 






* 




< 

















OOf-MENTS: 
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MATERIALS - page 4 



3. Are there sufficient instructional materials fox each studfent? 



jes 



COMMENTS : 



no 
- • 



4. Are there sufficient instructional materials of the type that you 
need to effectively implement Precision Teaching? 



_yes 



COMMENTS: 



no 



x 
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V, STUDENTS' PROGRESS 



FOR EACH ITEM BELOW, PLEASE MARK THE RESPONSE WHICH HOST CLEARLY 
REFLECTS YOUR OBSERVATION OF CHANGES DURING THIS SCHdOL YEAR , 
IF^ANY. IF A QUESTION DOES NOT APPLY TO YOUR PARTICULAR GRADE 
LtyVEL , PLEASE MARK THE BOX ENTITLED "NOT APPLICABLE \ 



1. Indicate your students' growth in 
the following mathematical areas: 



a. Math readiness , counting 



b. Clock arithmetic 



c. Addition, subtraction with 
? whole numbers 

4. Structure & properties (greater, 
less than, or equal) 

e. Problem-solving, addition & 
subtraction 

f . Geometry, recognition of shapes 



g. Measurement & application ('e.g., 
time, size, temperature) 

h. Multiplication, Division with 
Whole numbers' 

i. Fraction concept >" 
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j. Operations with fractions 



k. Decimals & per cents 



1. Problem-solving, estimation, 
averages, ratio, weight, etc. 

♦ 

m. Graphs & functions 

( 

n. Sets & logical ^reasoning 

o. Geometry, practical application 

of concepts, i.e. prisms, 
circles, lines, etc. 
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V, STUDENTS 1 PROGRESS- page 2 / 

2. Indicate -your students^ 
growth in the following reading 
areas: , , 
a, Word* Analysis 



\ 



1) Left to right sequencing 



2) Compound words, suffixes, pre- 
fixes, and ropts 

3) Sight recognition of whole 
words 

4) Sentence structure 0 

5) Consonants 

6) Short Vowels 

7) Long Vfcwels 

8) Contrasting Spelling Patterns 
(bat, mat, fat) 

9) Syllabication 
\ 

10) Word formation.^, 

lim j^^^f 4 *' 

' ^ ' ^ .l^afruTary Developmgftt ' ' 



1) Synonyms and Autonyms 

2) Word Origins 

3>) Words from content area subj 
(math, science, social studies) 

4) Crossword puzzle skill 
c, Reading Comprehension 



1) Following tfimple(^frecti6r^s 
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Greatly 
Improved 
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V. STUDENTS 1 PROGRESS-page 3 



2) Identifying main ideas 

' - Recalling details r ' „ 

»^»\ * 

4) Identifying cause Jc- effect 
relationship 

5) Determining author's motive 

6) Analyzing content 

7) Understanding riddles 

8) Using dictionaries . 

9) Summarizing a x story 
10) Outlining 



11) Reading with speed 

I i 

12) Reading maps, tables, graphs, 
etc. 



d. Language^4tts 



' , 1) Spelling 

2) Grammar 

3) /Punctuation 

,4) Handwriting-. ' ' 
i * f>) Listening skills ' 
6) Creative writing 
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, V. STUDENTS 1 PROGRE!aS-page. 4 



K 



3. Indicate your students 1 growth in 
the following areas: 



a* Your students 1 pleasure in reading 



b. Your students' use of the library 

c. Your students 1 feelings about their 
own reading abilities 

d. Your students 1 appreciation of read- 
ing skills in others 

e. Your students 1 feelings about their 
own math skills * 

f • Your students 1 appreciation of math 
skills in others 

g*. Your students 1 attendance and tardy 
rates 

h« Frequency of conflicts & negative 
behavior exhibited by students 

!• Your students 1 performance on daily 
homework assignments. 



COMMENTS : 
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VI. PARENT/COMMUNITY INVOLVEMENT ' . 

1. How many parents visib*i or volunteered in your classes 
this school year? 

^frequently occasionally 

2. How many parent-teacher conferences did you have during the 
year? 

3. Were the • pajrent-teacher* conferences more effective as a 
result of the Precision Teaching approach? 



_yes 



no 



4." How many parent workshops were held to explain Precision 
. Teaching procedures? 



5. In your opinion, how da parents like the Precision Teaching 
approach? / 



COMMENTS: 
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VII. What factors do you feel have, contributed most to the success 
(and/or lack of it) of Precision Teaching that^ you have cited 
above? 
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VIII. (continued) / 

Instructional approaches - materials 



Curriculum Development and/or Planning 



Parental/Community Involvement 
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X. Any other comments 




